Data Augmentation by Rubrics for Short Answer Grading

نویسندگان

چکیده

Short Answer Grading (SAG) is the task of scoring students’ answers for applications such as examinations or e-learning. Most existing SAG systems predict scores based only on answers, and critical evaluation criteria rubrics are ignored, which plays a crucial role in evaluating real-world situations. In this paper, we propose semi-supervised method to train neural model. We extract keyphrases that highly related from rubrics. Weights words calculated attention labels instead manually annotated labels, span-wise alignments between keyphrases. Only with weighed used supervision. evaluate proposed model two analytical assessment tasks analytic score prediction justification identification. Analytic predicting given answer prompt, Justification identification involves identifying cue student each score. Our experimental results demonstrate both performance grading improved by integrating training, especially low-resource setting.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Automatic Short -Answer Grading System (ASAGS)

Automatic assessment needs short answer based evaluation and automated assessment. Various techniques used are Ontology, Semantic similarity matching and Statistical methods. An automatic short answer assessment system is attempted in this paper. Through experiments performed on a data set, we show that the semantic ASAGS outperforms methods based on simple lexical matching; resulting is up to ...

متن کامل

Distributed Vector Representations for Unsupervised Automatic Short Answer Grading

We address the problem of automatic short answer grading, evaluating a collection of approaches inspired by recent advances in distributional text representations. In addition, we propose an unsupervised approach for determining text similarity using one-to-many alignment of word vectors. We evaluate the proposed technique across two datasets from different domains, namely, computer science and...

متن کامل

Text-to-Text Semantic Similarity for Automatic Short Answer Grading

In this paper, we explore unsupervised techniques for the task of automatic short answer grading. We compare a number of knowledge-based and corpus-based measures of text similarity, evaluate the effect of domain and size on the corpus-based measures, and also introduce a novel technique to improve the performance of the system by integrating automatic feedback from the student answers. Overall...

متن کامل

A Fluctuation Smoothing Approach for Unsupervised Automatic Short Answer Grading

We offer a fluctuation smoothing computational approach for unsupervised automatic short answer grading (ASAG) techniques in the educational ecosystem. A major drawback of the existing techniques is the significant effect that variations in model answers could have on their performances. The proposed fluctuation smoothing approach, based on classical sequential pattern mining, exploits lexical ...

متن کامل

Short Answer Grading Using String Similarity And Corpus-Based Similarity

Most automatic scoring systems use pattern based that requires a lot of hard and tedious work. These systems work in a supervised manner where predefined patterns and scoring rules are generated. This paper presents a different unsupervised approach which deals with students’ answers holistically using text to text similarity. Different String-based and Corpus-based similarity measures were tes...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Shizen gengo shori

سال: 2021

ISSN: ['1340-7619', '2185-8314']

DOI: https://doi.org/10.5715/jnlp.28.183